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METHODS AND SYSTEMS FOR LINKING VIRTUAL MEETING 
ATTENDEES OVER A NETWORK 

CROSS REFERENCE 
The present application claims priority under 35 U.S.C. §1 19 of 
U.S. Provisional Patent Application Nos. 60/431,476 and 60/431,600 both of 
which were filed on Dec. 6, 2002. 

FIELD OF THE INVENTION 
The present invention is related to methods and systems for 
communicating data over a network between users, such as between attendees 
of a virtual meeting. 

BACKGROUND OF THE INVENTION 
Many methods are known for communicating data over a 
network, including for communicating digital data between remote computers. 
One exemplary application of such methods is multi-user collaboration in 
which multiple users share video, audio, and/or other data with one another. 
For example, virtual meetings may be conducted across a data network in 
which users see and hear one another in substantially real time and also share 
other data such as digital documents, presentations, pre-recorded video or 
audio, and the like. Generally, each of the users communicates a plurality of 
data streams that include real time video streams, real time audio streams, and 
real time data streams. These streams are then bundled with all of the other 
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streams received from other meeting attendees and then communicated out to 
each of the participants so that all can see and hear all of the others. 

Although such applications are known, problems with them 
remain unresolved. For example, it may be desired to conduct virtual meetings 
between multiple users over a data network, with some of the users having 
different connectivity resources and/or needs. Depending on the number of 
participants, the amount of bandwidth required may be quite substantial. All 
users may not have the required amount of bandwidth available. For users with 
a limited amount of bandwidth participation in the virtual meeting may be 
impossible or impractical. 

Also, even if sufficient bandwidth is available to participate in the 
meeting, some users may not desire to devote all of the required bandwidth to 
the meeting. For example, in a virtual meeting that includes multiple speakers 
and data presentations, some users may only be interested in one particular 
video view (e.g., one particular speaker). Consuming all of the bandwidth 
required to receive the entire virtual meeting feed for these users is impractical 
and inefficient. 

The scale and number of virtual meetings exacerbates these and 
other problems. As more and more attendees are present, managing the various 
data streams and communications becomes more and more daunting. 
Additionally, multiple virtual meetings may be occurring simultaneously, and 
therefore need to be managed concurrently with one another. This adds further 
complexity. 

Unresolved needs in the art therefore remain. 

SUMMARY OF THE INVENTION 
The present invention is directed to methods and computer 
program products for communicating real time data streams between a plurality 
of virtual meeting attendees over a digital data network. One exemplary 
method of the invention includes the steps of receiving a plurality of real time 
data streams from each of a plurality of virtual meeting attendees, of linking a 
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first of the plurality of data streams from each of the attendees to a first 
network interface, and of linking a second data stream from each of the 
attendees to a second network interface. A step of allowing a requestor to 
selectively link to the first and/or second network interface is also included. 

Another exemplary embodiment of the invention is a method for 
linking data communications between a plurality of users in a virtual meeting 
on a data network. It includes steps of designating a first network interface for 
communicating real time video data streams, designating a second network 
interface for communicating real time audio data streams, querying the 
plurality of users to determine what types of real time data streams each will 
communicate to and from the network, and linking each individual user to one 
or both of the first and second network interfaces depending on what types of 
data said each selected. 

BRIEF DESCRIPTION OF THE FIGURES 

FIG. 1 is a schematic of a data network that is useful to describe 
an exemplary embodiment of the invention; 

FIG. 2 is a schematic of conference room 12 of FIG. 1; 

FIG. 3 is a schematic of an alternate conference room 12'; 

FIG. 4 is flowchart illustrating one exemplary embodiment of a 
method of the invention; 

FIG. 5 is a schematic useful to illustrate the method of FIG. 4; 

and 

FIG. 6 is a schematic useful to illustrate an additional invention 

embodiment. 

DETAILED DESCRIPTION 
Embodiments of the present invention are directed to methods 
and computer program products for communicating real time data streams 
between a plurality of virtual meeting attendees over a digital data network. It 
will be appreciated that program products of the invention may embody 



methods, and that methods of the invention may be practiced by a computer. A 
program product of the invention, for example, may be embodied in computer 
executable instructions stored on a computer readable memory that when 
executed cause one or more computers to perform steps of a method of the 
invention. Accordingly, it will be understood that description herein of a 
method embodiment of the invention may likewise apply to a computer 
program product, and likewise that description of a program product may apply 
to a method. 

Exemplary methods and program products of the invention may 
find particular utility when practiced in association with a virtual meeting. As 
used herein, the term "virtual meeting" is intended to be broadly interpreted as 
an event in which real time communications occur between meeting attendees 
that are not physically present with one another. By way of particular example, 
a virtual meeting can be an audio/video conference conducted between users 
remote from one another over a digital data network. Also, as used herein the 
term "real-time" is intended to be broadly interpreted as meaning substantially 
instantaneous. For example, telephone communications over a PSTN may be 
considered to be "real-time" in that when a telephone user speaks his voice data 
is received at a far end of the PSTN at substantially the same time it is 
transmitted (although some small delay occurs). 

FIGS. 1 and 2 are schematics of a network 10 and meeting 
conference rooms 12 that are useful to further describe an embodiment of the 
present invention. FIG. 1 shows a network 10 with a plurality of conference 
rooms 12 connected thereto. The conference rooms 12 may be considered to 
be meeting "users" or "attendees" for convenience. The network 10 may be 
any suitable interconnection for communicating data between the conference 
rooms 12, with examples including a digital data network, the PSTN, a wireless 
network, and the like. A preferred network 10 for practicing the invention 
includes a digital network configured for carrying packet-based data, such as an 
internet protocol network. These networks are believed to show great promise 
for carrying real-time video conferences with a high quality of service, at a 
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reasonable cost, and in a highly immersive environment that is rich in data 
sharing. 

The conference rooms 12 are remote from one another, and may, 
for example, be different rooms in the same building, or be rooms at different 
buildings. They may be in different states or countries from one another. Each 
of the conference rooms 12 are connected by a communications connection 14 
to an interface 16 connected to the network 10. The communications 
connection 14 may be a wire, a wireless connection, or other like linkage 
suitable for carrying communications such as packet-based digital data. The 
term "interface" as used herein is intended to be broadly interpreted as meaning 
one or more links useful to electronically connect different users to one 
another. An interface may be hardware and/or software. It may be, for 
example, a bridge, a network card, a computer server or router, a software 
switch, one or more ports, or the like. In one exemplary invention 
embodiment, the interface is a port, while in another it is a group of ports. 

FIG. 2 is a schematic illustration of a typical conference room 12. 
It generally includes a plurality of cameras 16, 18 and 20, and a plurality of 
microphones 22 and 24. The cameras 16, 18 and 20 and the microphones 22 
and 24 may be trained on a speaker 26, an audience 28 and a data presentation 
30. The cameras 16, 18, 20 and microphones 22 and 24 are linked to a 
computer 32 which may include a coder module for encoding the signals of 
cameras 16, 18 and 20 and the microphones 22 and 24. The computer 32 is 
also useful for communicating the signals to the network 10 over the linkage 
14. 

The computer 32 also receives communications from the network 
10. The received communications can include real time video and audio data 
streams from the other conference rooms 12, as well as other data such as 
application data, replayed video, graphics and the like. The computer 32 may 
include a decoder for decoding received signals. The audio streams may be 
played over the speakers 34, and video streams sent to one or more projectors 
36 for displaying on a screen 38. The images 40 displayed on the screen 38 
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may include speakers, audiences, documents, recorded video, and the like 
received from other of the conference rooms 12. 

It will be appreciated that the configuration of conference room 
12 as illustrated in FIG. 2 is exemplary only, and that many other 
configurations are possible. Those skilled in the art will appreciate that the 
particular configuration may be established as will be useful for a particular 
application. More or fewer cameras and microphones could be present, for 
example. Also, the projector 32 and screen 36 could be replaced by one or 
more monitors. By way of particular example, FIG. 3 illustrates another 
possible configuration for a conference room that has been designated 12' for 
convenience. The conference room 12' may be representative of a traveling 
salesman or executive participating in a virtual meeting from a hotel room, 
home, or even from a mobile location (e.g., the room 12' could represent a 
mobile device). The conference room 12' includes a computer 42 linked to the 
network 10 by the communications connection 14. The computer 42 allows for 
real time video streams to be displayed, and a speaker 44 plays real time audio 
streams. No input is provided from the room 12' to the conference, it is used 
only for viewing and listening to participants at the other conference rooms 12. 
It will be appreciated, however, that a single camera and microphone could 
easily be added to the configuration of room 12'. 

Having described an exemplary network and exemplary 
conference rooms useful for practice of the present invention, an exemplary 
method will now be illustrated. FIG. 4 is a flowchart of one exemplary method 
100. The method 100 includes a step of allowing meeting attendees to 
selectively link to any of the interfaces (block 102). This can occur through an 
operator or other person at the meeting conference rooms 12 and 12' 
connecting to a virtual meeting interface and specifying what meeting they will 
be attending, and what data streams they wish to communicate to and from the 
meeting. For example, a meeting attendee may specify that he desires to 
communicate video and audio data to the meeting, and to receive video, audio, 
and application data. 
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As used herein, the term "application data" is intended to broadly 
refer to data from a software application. Examples of application data include, 
but are not limited to, documents such as Microsoft Word, spreadsheets such as 
Microsoft Excel, databases such as Microsoft Access, pre-recorded video 
and/or audio, graphics programs, illustrations, and the like. Although some of 
these applications are sometimes unchanging data, within practice of the 
invention they are embodied in real time data streams. A Word document, for 
example, may be worked on collaboratively between multiple conference 
rooms with its current status streamed in real time from each conference room. 

In the exemplary method 100, an additional data stream is 
contemplated. In particular, an "auxiliary" data stream may be communicated. 
As used herein, the "auxiliary" data stream is intended to be broadly interpreted 
as any one or more streams selected from the larger group of streams of a 
virtual meeting. An auxiliary data stream(s) may be selected on the basis of 
importance, subject matter, or other criteria. For example, in a large meeting 
there may be one video and audio stream devoted to a main speaker, and many 
additional video and audio streams dedicated to secondary speakers or audience 
members. In this case the video and data streams dedicated to the main 
speaker may be the auxiliary streams. Or, a virtual meeting may include 
discussion of a pre-recorded event or other stored data stream. This stored 
stream could be designated as the auxiliary stream. 

The data streams are preferably packet-based, with internet 
protocol ("IP") format being an example. Each data packet may include header 
information that identifies a source and/or a destination by an identifier such as 
an IP address. One particular example of a suitable format is Real-Time 
Transport Protocol ("RTP"). RTP is known to be useful for communication of 
real time data streams over IP networks, including in association with video 
and audio data. Those skilled in the art will appreciate that RTP protocol 
generally encompasses communication of data in a discrete data portion and a 
discrete control portion. 
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The real time data streams are received by an interface connected 
to the data network. The schematic of FIG. 5 is useful to further illustrate this 
step. The interface 16 has been illustrated as a computer containing a bridge 
54. The computer 16 may include, for instance, a network card and have 
software running on it that creates the bridge 54. The bridge 54 may further 
include a plurality of individually addressable ports 1000A1-1001E2. Data 
streams are received from a plurality of conference rooms 12 that are 
participating in each of a first virtual meeting, represented by the dashed line 
circle 50, and a second virtual meeting represented by the dashed line circle 52. 
These two virtual meetings can be occurring at least partially concurrently with 
one another (e.g., there is at least some overlap between the duration of the two 
meetings). 

When first and second meetings commence, a plurality of data 
streams are received from each of them. With reference to the schematic of 
FIG. 2, the real time data streams received from each conference room may 
include, for example, a plurality of real time video data streams, a plurality of 
real time audio data streams, and real time application data. 

The exemplary method 100 proceeds to a series of steps of 
linking the various streams to individual interfaces. The dashed line box 106 
illustrates these steps associated with the first virtual meeting. Only the video 
data streams from each of the conference rooms participating in the first virtual 
meeting are linked to a first interface (block 108). Only the audio streams are 
sent to a second interface (block 110), only the application data is sent to a 
third interface (block 112), and only the auxiliary data stream to a fourth 
interface (block 1 14). Similar steps are also carried out to link only the video 
data streams from the second meeting attendees to a fifth interface (block 116), 
only the audio data streams to a sixth interface (block 1 1 8), only application 
data to a seventh interface (block 120), and only the auxiliary data streams to 
an eighth interface (block 122). For example, if a conference room 
participating in the first meeting has indicated that it desires to receive 
application data only, it will be linked to the third interface. 
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The first through eighth interfaces may be, for example, ports of a 
software bridge that each has an individual network address. In the case of the 
preferred RTP protocol communications, the interfaces may be port pairs, with 
a first port being linked to the RTP stream data portion and the second port of 
the pair being linked to the RTP stream control portion. Also, the conference 
rooms are linked to interfaces as they have indicated to receive streams 
communicated from the network. 

The steps of blocks 108-122 may be further understood by 
reference to FIG. 5, as well as Table 1 that describes the various ports and their 
content: 



Port No: 


Description: 


1000A1 


Meeting 1: Video only; CONTROL 


1000A2 


Meeting 1 : Video only; DATA 


1000B1 


Meeting 1: Audio only; CONTROL 


1000B2 


Meeting 1 : Audio only; DATA 


1000C1 


Meeting 1 : Application; CONTROL 


1000C2 


Meeting 1 : Application; DATA 


1000D1 


Meeting 1 : Auxiliary Stream; 
CONTROL 


1000D2 


Meeting 1 : Auxiliary Stream; DATA 




1001A1 


Meeting 2: Video only; CONTROL 


1001A2 


Meeting 2: Video only; DATA 


1001B1 


Meeting 2: Audio only; CONTROL 


1001B2 


Meeting 2: Audio only; DATA 


1001C1 


Meeting 2: Application; CONTROL 


1001C2 


Meeting 2: Application; DATA 


1001D1 


Meeting 2: Auxiliary Stream; 
CONTROL 


1001D2 


Meeting 2: Auxiliary Stream; DATA 



In FIG. 5, the port pairs of TABLE 1 have been collectively represented as the 
bridge 54. It will be appreciated that the bridge 54 can be a software bridge 
that is created by program instructions being executed by the computer 16. 
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Thus the method 100 achieves important advantages and benefits. 
For example, through practice of the method 100, a meeting attendee is able to 
tailor his virtual meeting experience by choosing which portion of the data 
streams to send and receive. Thus if a mobile user with limited bandwidth and 
other resources such as the mobile user illustrated in the conference room 12' 
of FIG. 3 should choose to receive audio only, to receive video only, or to 
receive only audio and video, he may do so by specifying which interfaces to 
link to. It is contemplated, for instance, that a user could call into a virtual 
meeting over a phone and participate only by audio. Also, an attendee may be 
advised that his bandwidth is not sufficient to support communication of all 
data streams and be directed to one or more particular channels that can be 
supported. 

In an additional embodiment of the invention, the network 
interface that particular data streams are linked to is not a single port, but is 
instead a group of ports. FIG. 6 is a schematic useful to illustrate this 
embodiment. Because this represents an alternate configuration to that of FIG.. 
5, consistent element numbers will be used with a double-prime " designation. 
Referring now to FIG. 6, each attendee 12" is linked to a first interface that 
includes ports 1001 and 1002 within the bridge 54", and is linked to a second 
interface that includes ports 1003 and 1004 within the bridge 54". 

Video data streams may be sent by each attendee 12" to the first 
interface, and audio to the second. That is, one attendee 12" sends video data 
streams to port 1001, and one attendee to port 1002. The stream received over 
port 1001 is sent out over 1002, and the stream received over 1002 is sent out 
over 1001. In this manner each attendee 12" connects to one port and receives 
all video data streams over that port. Likewise the audio streams received over 
port 1003 from one attendee 12" are sent to the second attendee 12" over the 
port 1004 that it is linked to. In this manner the two ports 1001 and 1002 
collectively form an interface to which video data streams are linked, and ports 
1003 and 1004 form a second interface to which audio data streams are linked. 
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Other invention embodiments may include additional steps 
related to tracking usage of the interfaces. For example, steps of recording 
linkage time or data communicated to each particular interface and for each 
particular attendee may be performed. One exemplary set of steps includes 
recording log-in and log-out time for each attendee at each interface. The 
interfaces can be made available at a per-unit time fee, with different interfaces 
having different fees. An attendee will incur a total fee that equals the total 
units of time connected to an interface multiplied by the per-unit fee for that 
interface. Another set of exemplary steps includes measuring the amount of 
data sent over each interface to each attendee. The data may be measured in 
units of bytes, bits, packets, or other useful units. A per-unit measure of data 
charge can be applied to the data consumed to bill users for their usage. 

Steps of recording the usage for each interface and by each 
attendee can also be useful for a wide variety of purposes other than 
accounting. It will be appreciated that the information acquired through these 
steps can serve as a blueprint that shows what content for how long. 

Methods of the invention may further include steps of assigning 
identifiers to the interfaces. Each of the virtual meetings may be assigned an 
identifier, such as a numeric code. Interfaces within each of the meetings may 
be assigned consistent identifiers. These steps may be illustrated by reference 
to FIG. 5 and Table 1. The first virtual meeting illustrated as meeting 50 has 
been assigned an identifier 0, and the second meeting illustrated as meeting 52 
has been assigned an identifier 1 . Interfaces linked to only video data streams 
have been assigned A, with only audio data streams B, with only application 
data streams C, and with only auxiliary data streams D. Because the exemplary 
application contemplated by Table 1 and FIG. 5 utilizes RTP protocol data 
streams, each interface includes a pair of ports assigned identifiers of 1 and 2. 
Port 1 corresponds to the control portion of the data stream, and port 2 to the 
data portion. In the exemplary application of FIG. 5 and Table 1, port numbers 
are assigned beginning at 1000, with the result that 1000 is added to the 
meeting identifier (e.g., meeting 1 becomes 1000, and meeting 2 1001). 
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These steps can be summarized as assigning an identifier of: 
(1000 + IVO X Y 

to each interface, where: 

• M is a meeting number (e.g., 0 or 1 for the two meetings of the 
example application) 

• X is an identifier for the type of data stream linked to the 
interface (e.g., A for video only, B for audio only, C for 
application only, and D for auxiliary) 

• Y is an identifier for RTP data stream portion (e.g., 1 for control 
portion, 2 for data portion). 

By way of particular example, the port for the data portion of the video only 
streams from all of the conference rooms in the first virtual meeting will be 
assigned the identifier: 1000A2. This was derived as follows: 1000 (= 1000 + 
0), A (= video only), and 2 (== data portion). As a result, each interface or port 
has an identifier associated with it that carries inherent knowledge. That is, by 
examining a particular interface identifier, the data streams linked thereto can 
be identified, and vice versa. It will be appreciated that this provides 
substantial benefits, particularly in applications where tens, hundreds, or more 
virtual meetings are being conducted simultaneously, with each having a 
multiplicity of data streams. Under these circumstances, managing, organizing 
and accessing the large number of interfaces used can be a time consuming and 
difficult task. Methods of the invention substantially reduce the effort and time 
associated with these tasks. 

Methods and program products of the invention may further 
include performing steps of data traffic management. For example, steps may 
be performed of setting a priority (IP Precedence or DSCP) of outgoing traffic 
streams based on the type of data stream assigned to a particular port. This 
allows for data streams to be re-classified when they are received from a source 
that does not classify traffic, or when the classification may have been reset 
during network transit. Other traffic management steps may include 
segregating data streams to different interfaces based on bandwidth. A 
particular range of ports, for example, may be classified as "high" bandwidth 
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ports, and another as "low" bandwidth ports. Meeting attendees with limited 
bandwidth can select from the low bandwidth ports to link to with confidence 
that they can support link. 

Other exemplary steps of data stream management are useful for 
interfacing between unicast and multicast formats. For example, exemplary 
steps include designating particular interfaces as unicast interfaces, and others 
as multicast interfaces. The exemplary steps further include receiving one or 
more unicast data streams, and making these available for multicast 
communication at the designated multicast interfaces. Similarly, multicast data 
streams received may be made available for unicast communication at the 
designated unicast interfaces. In this manner methods and program products of 
the invention allow for unicast clients to participate in an otherwise multicast 
based meeting, and vice-versa. 

Still other exemplary steps of data stream management may be 
useful to control security aspects of the virtual meeting. For example, method 
steps of designating particular interfaces as "receive only" allow users to send 
traffic to the virtual meeting without receiving the group data stream traffic. 
Other steps include designating some interfaces as "secure," and linking 
sensitive data streams to these interfaces. A password or other verification may 
be required from a meeting attendee before he is allowed to link to this 
interface. 

Those skilled in the art will appreciate that the exemplary 
embodiments described and discussed herein have been selected as being 
exemplary only, and that the invention is not limited to these examples. For 
example, although examples have been illustrated with particular numbers of 
meeting attendees and data streams, it will be appreciated that the method of 
the invention may be practiced on any practical scale. Invention methods and 
program products may be practiced, for example, with virtual meetings that 
include tens, hundreds, or more conference rooms and/or attendees, and with 
real time data streams that far outnumber the one illustrated herein. Indeed, the 
method may be practiced with any number n of streams and interfaces, where n 
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is a positive integer. Also, it will be appreciated that although exemplary 
method and program products have been illustrated in a particular sequence of 
steps, the sequence is not necessarily important to the invention and could 
easily be altered. Computer program embodiments of the invention are also 
not limited to a single computer, but may be practiced by a plurality of 
computers. 
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